Valido: A Visual Tool for Validating Sense Annotations
نویسنده
چکیده
In this paper we present Valido, a tool that supports the difficult task of validating sense choices produced by a set of annotators. The validator can analyse the semantic graphs resulting from each sense choice and decide which sense is more coherent with respect to the structure of the adopted lexicon. We describe the interface and report an evaluation of the tool in the validation of manual sense annotations.
منابع مشابه
Squibs: Consistent Validation of Manual and Automatic Sense Annotations with the Aid of Semantic Graphs
The task of annotating texts with senses from a computational lexicon is widely recognized to be complex and often subjective. Although strategies like interannotator agreement and voting can be applied to deal with the divergences between sense taggers, the consistency of sense choices with respect to the reference dictionary is not always guaranteed. In this article, we introduce Valido, a vi...
متن کاملConsistent Validation of Manual and Automatic Sense Annotations with the Aid of Semantic Graphs
The task of annotating texts with senses from a computational lexicon is widely recognized to be complex and often subjective. Although strategies like interannotator agreement and voting can be applied to deal with the divergences between sense taggers, the consistency of sense choices with respect to the reference dictionary is not always guaranteed. In this article, we introduce Valido, a vi...
متن کاملSupporting Large-Scale Knowledge Acquisition with Structural Semantic Interconnections
In this paper, we discuss the use of a semantic disambiguation algorithm, Structural Semantic Interconnections (SSI), as a tool to support the process of semantic knowledge collection from a web community of volunteers. Starting from implicit knowledge in the form of sentences, terminology or collocations, SSI provides suggestions for sense selection in the form of semantic graphs that voluntee...
متن کاملValidating Real-Time Constraints in Embedded Systems
ABSTRACT There is a growing demand for software tools that an assist in designing, analyzing and validating embedded real-time system appli ations. Validating real-time onstraints in embedded systems plays a major role in the development of reliable robust systems. Esterel a syn hronous languageis widely used in the development of embedded systems and hardware/software odesign. In this paper, w...
متن کاملFacilitating Reconciliation of Inter-Annotator Disagreements
Development and evaluation of Natural Language Processing methods often requires text annotation. To gauge the difficulty of the task and increase the reliability and quality of annotations, researchers often recruit at least two annotators. The discrepancies in annotations by multiple annotators need to be identified and reconciled. We present a tool that identifies and helps reconciling and v...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2006